update alter_sync settings by jgao54 · Pull Request #4173 · PeerDB-io/peerdb

jgao54 · 2026-04-14T02:05:03Z

This avoids race condition where delay in DDL propagation can result in confusing user-facing errors that get auto-corrected on subsequent retry.

codecov · 2026-04-14T02:21:21Z

❌ 2 Tests Failed:

Tests completed	Failed	Passed	Skipped
2165	2	2163	183

View the top 3 failed test(s) by shortest run time

github.com/PeerDB-io/peerdb/flow/e2e::TestApiPg

Stack Traces | 0.01s run time

=== RUN   TestApiPg
=== PAUSE TestApiPg
=== CONT  TestApiPg
--- FAIL: TestApiPg (0.01s)
2026/04/14 02:15:13 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,v1,hv,sv FROM e2e_test_pg_mtr1c3qh.\"pg_pgvector\" ORDER BY id"
2026/04/14 02:15:13 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,v1,hv,sv FROM e2e_test_pg_mtr1c3qh.\"pg_pgvector\" ORDER BY id"
2026/04/14 02:15:13 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_7262915052312633718 CURSOR FOR SELECT id,v1,hv,sv FROM e2e_test_pg_mtr1c3qh.\"pg_pgvector\" ORDER BY id" args=[]
2026/04/14 02:15:13 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,v1,hv,sv FROM e2e_test_pg_mtr1c3qh.\"pg_pgvector\" ORDER BY id" channelLen=0
2026/04/14 02:15:13 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_7262915052312633718
2026/04/14 02:15:13 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_7262915052312633718 records=2 bytes=76 channelLen=1
2026/04/14 02:15:13 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,v1,hv,sv FROM e2e_test_pg_mtr1c3qh.\"pg_pgvector\" ORDER BY id" rows=2 bytes=76 channelLen=1
2026/04/14 02:15:13 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_7262915052312633718
2026/04/14 02:15:13 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_7262915052312633718 records=0 bytes=0 channelLen=0
2026/04/14 02:15:13 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,v1,hv,sv FROM e2e_test_pg_mtr1c3qh.\"pg_pgvector\" ORDER BY id" rows=0 bytes=0 channelLen=0
2026/04/14 02:15:13 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2026/04/14 02:15:13 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,v1,hv,sv FROM e2e_test_pg_mtr1c3qh.\"pg_pgvector\" ORDER BY id" rows=2 bytes=76 channelLen=0
2026/04/14 02:15:13 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,v1,hv,sv FROM e2e_test_pg_mtr1c3qh.\"pg_pgvector_dst\" ORDER BY id"
2026/04/14 02:15:13 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,v1,hv,sv FROM e2e_test_pg_mtr1c3qh.\"pg_pgvector_dst\" ORDER BY id"
2026/04/14 02:15:13 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_9229892188128571298 CURSOR FOR SELECT id,v1,hv,sv FROM e2e_test_pg_mtr1c3qh.\"pg_pgvector_dst\" ORDER BY id" args=[]
2026/04/14 02:15:13 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,v1,hv,sv FROM e2e_test_pg_mtr1c3qh.\"pg_pgvector_dst\" ORDER BY id" channelLen=0
2026/04/14 02:15:13 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_9229892188128571298
2026/04/14 02:15:13 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_9229892188128571298 records=1 bytes=152 channelLen=0
2026/04/14 02:15:13 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,v1,hv,sv FROM e2e_test_pg_mtr1c3qh.\"pg_pgvector_dst\" ORDER BY id" rows=1 bytes=152 channelLen=0
2026/04/14 02:15:13 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_9229892188128571298
2026/04/14 02:15:13 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_9229892188128571298 records=0 bytes=0 channelLen=0
2026/04/14 02:15:13 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,v1,hv,sv FROM e2e_test_pg_mtr1c3qh.\"pg_pgvector_dst\" ORDER BY id" rows=0 bytes=0 channelLen=0
2026/04/14 02:15:13 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2026/04/14 02:15:13 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,v1,hv,sv FROM e2e_test_pg_mtr1c3qh.\"pg_pgvector_dst\" ORDER BY id" rows=1 bytes=152 channelLen=0

github.com/PeerDB-io/peerdb/flow/e2e::TestApiPg/TestMongoDBOplogRetentionValidation

Stack Traces | 0.03s run time

=== RUN   TestApiPg/TestMongoDBOplogRetentionValidation
=== PAUSE TestApiPg/TestMongoDBOplogRetentionValidation
=== CONT  TestApiPg/TestMongoDBOplogRetentionValidation
    clickhouse.go:115: 
        	Error Trace:	.../flow/e2e/congen.go:43
        	            				.../flow/e2e/clickhouse.go:115
        	            				.../flow/e2e/clickhouse.go:97
        	            				.../flow/e2e/clickhouse.go:432
        	            				.../flow/e2e/api_test.go:232
        	            				.../flow/e2eshared/e2eshared.go:34
        	Error:      	Received unexpected error:
        	            	unable to establish connection with catalog: FATAL: terminating connection due to administrator command (SQLSTATE 57P01)
        	Test:       	TestApiPg/TestMongoDBOplogRetentionValidation
--- FAIL: TestApiPg/TestMongoDBOplogRetentionValidation (0.03s)

github.com/PeerDB-io/peerdb/flow/e2e::TestApiPg/TestTableAdditionWithoutInitialLoad

Stack Traces | 5.14s run time

=== RUN   TestApiPg/TestTableAdditionWithoutInitialLoad
=== PAUSE TestApiPg/TestTableAdditionWithoutInitialLoad
=== CONT  TestApiPg/TestTableAdditionWithoutInitialLoad
2026/04/14 02:13:10 INFO Received AWS credentials from peer for connector: ci x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2026/04/14 02:13:10 INFO Received AWS credentials from peer for connector: clickhouse x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2026/04/14 02:13:10 INFO fetched schema x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} table=e2e_test_api_iyqycefm.table1
    api_test.go:2284: WaitFor wait for initial load to finish 2026-04-14 02:13:14.570975082 +0000 UTC m=+221.510743761
2026/04/14 02:13:14 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_thcvg092.\"original\" ORDER BY id"
2026/04/14 02:13:14 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_thcvg092.\"original\" ORDER BY id"
2026/04/14 02:13:14 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_6541848936883851791 CURSOR FOR SELECT id,val FROM e2e_test_api_thcvg092.\"original\" ORDER BY id" args=[]
2026/04/14 02:13:14 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_thcvg092.\"original\" ORDER BY id" channelLen=0
2026/04/14 02:13:14 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_6541848936883851791
2026/04/14 02:13:14 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_6541848936883851791 records=1 bytes=9 channelLen=0
2026/04/14 02:13:14 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_thcvg092.\"original\" ORDER BY id" rows=1 bytes=9 channelLen=0
2026/04/14 02:13:14 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_6541848936883851791
2026/04/14 02:13:14 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_6541848936883851791 records=0 bytes=0 channelLen=0
2026/04/14 02:13:14 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_thcvg092.\"original\" ORDER BY id" rows=0 bytes=0 channelLen=0
2026/04/14 02:13:14 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2026/04/14 02:13:14 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_thcvg092.\"original\" ORDER BY id" rows=1 bytes=9 channelLen=0
    api_test.go:2294: WaitFor wait for pause for add table 2026-04-14 02:13:14.585905995 +0000 UTC m=+221.525674674
2026/04/14 02:13:14 INFO fetched schema x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} table=e2e_test_api_iyqycefm.table1
    api_test.go:2295: UNEXPECTED ERROR unable to establish connection with catalog: FATAL: terminating connection due to administrator command (SQLSTATE 57P01)
    api_test.go:48: begin tearing down postgres schema api_thcvg092
--- FAIL: TestApiPg/TestTableAdditionWithoutInitialLoad (5.14s)

To view more test analytics, go to the Test Analytics Dashboard
_{📋 Got 3 mins? Take this short survey to help us improve Test Analytics.}

github-actions · 2026-04-14T02:25:32Z

🔄 Flaky Test Detected

Analysis: All three failing e2e test jobs show transient infrastructure failures: two are WaitFor polling loops that timed out waiting for replication to complete, and one explicitly failed with SQLSTATE 57P01 (PostgreSQL admin shutdown), none of which are attributable to code changes in this commit.
Confidence: 0.93

✅ Automatically retrying the workflow

View workflow run

github-actions · 2026-04-14T02:44:08Z

🔄 Flaky Test Detected

Analysis: Both failing matrix jobs (mysql-pos and mysql-gtid) hit the same transient infrastructure error — FATAL: terminating connection due to administrator command (SQLSTATE 57P01) — meaning the CI PostgreSQL catalog was restarted/killed mid-test, not a code defect.
Confidence: 0.97

✅ Automatically retrying the workflow

View workflow run

update alter_sync settings

bc494ed

ilidemi approved these changes Apr 14, 2026

View reviewed changes

jgao54 enabled auto-merge (squash) April 14, 2026 02:07

jgao54 merged commit 8dcffc2 into main Apr 14, 2026
16 of 21 checks passed

jgao54 deleted the joygao/alter-sync branch April 14, 2026 03:01

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

update alter_sync settings#4173

update alter_sync settings#4173
jgao54 merged 1 commit into
mainfrom
joygao/alter-sync

jgao54 commented Apr 14, 2026 •

edited

Loading

Uh oh!

codecov Bot commented Apr 14, 2026

Uh oh!

github-actions Bot commented Apr 14, 2026

Uh oh!

github-actions Bot commented Apr 14, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Uh oh!

Conversation

jgao54 commented Apr 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

codecov Bot commented Apr 14, 2026

❌ 2 Tests Failed:

Uh oh!

github-actions Bot commented Apr 14, 2026

🔄 Flaky Test Detected

Uh oh!

github-actions Bot commented Apr 14, 2026

🔄 Flaky Test Detected

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

jgao54 commented Apr 14, 2026 •

edited

Loading